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Objectives: Increased listening effort in school-age children with hear- 
ing loss (CHL) could compromise learning and academic achievement. 
Identifying a sensitive behavioral measure of listening effort for this 
group could have both clinical and research value. This study examined 
the effects of signal-to-noise ratio (SNR), hearing loss, and personal 
amplification on 2 commonly used behavioral measures of listening 
effort: dual-task visual response times (visual RTs) and verbal response 
times (verbal RTs). 


Design: A total of 82 children (aged 6-13 years) took part in this study; 
37 children with normal hearing (CNH) and 45 CHL. All children per- 
formed a dual-task paradigm from which both measures of listening 
effort (dual-task visual RT and verbal RT) were derived. The primary task 
was word recognition in multi-talker babble in three individually selected 
SNR conditions: Easy, Moderate, and Hard. The secondary task was a 
visual monitoring task. Listening effort during the dual-task was quanti- 
fied as the change in secondary task RT from baseline (single-task visual 
RT) to the dual-task condition. Listening effort based on verbal RT was 
quantified as the time elapsed from the onset of the auditory stimulus 
to the onset of the verbal response when performing the primary (word 
recognition) task in isolation. CHL completed the task aided and/or 
unaided to examine the effect of amplification on listening effort. 


Results: Verbal RTs were generally slower in the more challenging SNR 
conditions. However, there was no effect of SNR on dual-task visual RT. 
Overall, verbal RTs were significantly slower in CHL versus CNH. No 
group difference in dual-task visual RTs was found between CNH and 
CHL. No effect of amplification was found on either dual-task visual RTs 
or verbal RTs. 


Conclusions: This study compared dual-task visual RT and verbal RT 
measures of listening effort in the child population. Overall, verbal RTs 
appear more sensitive than dual-task visual RTs to the negative effects 
of SNR and hearing loss. The current findings extend the literature on 
listening effort in the pediatric population by demonstrating that, even 
for speech that is accurately recognized, school-age CHL show a greater 
processing speed decrement than their normal-hearing counterparts, a 
decrement that could have a negative impact on learning and academic 
achievement in the classroom. 
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INTRODUCTION 


For children with hearing loss (CHL), assessment of auditory 
function in the clinic typically consists of pure-tone and speech 
audiometry testing in controlled settings. However, everyday 
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listening occurs in complex (often noisy) acoustic environ- 
ments. Children develop key cognitive, linguistic, and academic 
skills in the classroom—an acoustically adverse environment 
with reported signal-to-noise ratios (SNRs) ranging from +1 to 
+11 dB (Larsen & Blair, 2008; Sato & Bradley, 2008). Speech 
understanding in noise relies on cognitive skills such as work- 
ing-memory and attention, which are still undergoing a pro- 
cess of maturation in school-age children (Gomes et al., 2000; 
Luna et al., 2004). The increased mental demands of listening 
in adverse conditions will likely interfere with a child’s abil- 
ity to perform important cognitive functions, like memorizing 
and comprehending information (Howard et al., 2010; Klatte 
et al., 2010). Owing to the importance of higher level cogni- 
tive abilities for communicative success in CHL, an increas- 
ing number of studies have sought to measure the allocation of 
mental resources during listening (i.e., “listening effort”) using 
behavioral and/or physiological methods (Amlani & Russo, 
2016; Grieco-Calub et al., 2017; Gustafson et al., 2014; Hicks 
& Tharpe, 2002; Howard et al., 2010; Hsu et al., 2017; Hughes 
& Galvin, 2013; McFadden & Pittman, 2008; McGarrigle 
et al., 2017; Steel et al., 2015; Stelmachowicz et al., 2007). A 
sensitive and reliable measure of listening effort could help 
to provide a more comprehensive assessment of the disability 
associated with listening in challenging environments for CHL. 
One behavioral method commonly used to measure listen- 
ing effort is the “dual-task” paradigm, which has been used in 
the field of cognitive psychology to measure attention allocation 
(Broadbent, 1958; Kahneman, 1973; Styles, 2006). During the 
dual-task paradigm, participants are asked to perform two tasks 
(a “primary” task and a “secondary” task), each completed in 
isolation and concurrently. In the case of measuring listening 
effort, the primary task typically involves listening (e.g., speech 
recognition) in different acoustic conditions, while the second- 
ary task varies substantially across studies, but usually involves 
performance on either a memory or nonauditory (e.g., visual, 
motor or tactile) response task. Secondary task performance 
can be quantified in terms of accuracy or response speed and is 
generally measured in isolation (single-task performance) and 
in conjunction with the primary task (dual-task performance). 
Any performance decrement (accuracy or response speed) on 
the secondary task when multi-tasking is interpreted as reflect- 
ing the allocation of resources shifted from the secondary task 
to the primary (listening) task. This decrement is therefore 
interpreted as the effort required to listen (Gagné et al., 2017). 
Hicks and Tharpe (2002) assessed dual-task performance in 
a small group of children with normal-hearing (CNH; n = 10) 
and in children with mild-to-moderate hearing loss (n = 10), all 
between 5 and 11 years old. All but one of the CHL wore their 
hearing aids during testing. The primary task was word recogni- 
tion in multi-talker babble at varying SNRs (+ 20 dB, + 15 dB, 
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and + 10 dB). The secondary task required participants to press a 
button every time a light probe was displayed. Overall, secondary 
task response times (RTs) were slower in the CHL compared with 
the CNH, suggesting increased listening effort. Given the rela- 
tively favorable SNRs used in this study, the authors suggested 
that these findings might underestimate the difficulty faced by 
CHL in noisy classrooms. Howard et al (2010) investigated 
listening effort in CNH using the dual-task paradigm at SNRs 
more representative of a typical classroom (-4, 0, and +4 dB) 
and found evidence of a systematic increase in listening effort 
as SNRs became more challenging. Given that CHL generally 
show greater difficulty understanding speech in noise than CNH 
(Leibold et al., 2013; Ruscetta et al., 2005), it is likely they will 
also experience greater listening effort in more adverse SNRs. 

The dual-task method has high ecological validity; individu- 
als are often tasked with performing multiple cognitive opera- 
tions simultaneously, particularly in a learning environment 
(e.g., following a teacher’s instructions while taking notes). How- 
ever, interpretation of dual-task results relies on the assumption 
that specific tasks can be prioritized and/or cognitive resources 
can be distributed among multiple concurrent tasks (Gagné 
et al. 2017). While this executive control ability is thought to be 
intact in most adult populations, previous research indicates that 
this ability is not yet fully developed in school-age children. For 
example, Choi et al. (2008) examined top-down control of atten- 
tion in children (ages 7-14 years) using the dual-task method. In 
their study, participants were asked to prioritize either the word 
recognition or digit-recall task. Participants performed consis- 
tently well on word-recognition and consistently poor on digit 
recall in the dual-task condition, despite receiving instructions 
to prioritize one task over the other. These findings suggest that 
school-age children have some difficulty allocating their atten- 
tion in a preferential way during multi-tasking situations. 

As an alternative to recording secondary-task RTs in a 
dual-task paradigm, verbal RTs are also believed to reflect lis- 
tening effort (Houben et al., 2013). To assess verbal RTs, par- 
ticipants are typically asked to respond to an auditory stimulus, 
for example, verbally repeating a word/sentence. The interval 
between the stimulus offset and the verbal response is used as a 
measure of the effort required to achieve accurate performance. 
That is, slower verbal RTs are taken to reflect increased effort. 
Research in the adult population suggests that verbal RTs could 
provide supplementary information to accuracy measures alone 
(Houben et al., 2013; Pals et al., 2015). In particular, RTs have 
been shown to reveal benefit from amplification in listeners with 
hearing loss (Gatehouse & Gordon, 1990) and increased listen- 
ing effort in more challenging SNRs (Houben et al., 2013; Pals 
et al., 2015). The use of the verbal RTs as a measure of listen- 
ing effort may have some advantages compared with dual-task 
measures in that, if automated, RT information can be relatively 
simple to obtain alongside a routine speech recognition assess- 
ment (Houben et al., 2013; Pals et al., 2015). 

Lewis et al. (2016) examined the effects of stimulus type 
(consonant, word, and sentence recognition) and SNR (-5, 0, 
and +5 dB) on verbal RTs in three groups of school-age children 
(aged 5—12 years): (1) CNH, (2) children with mild bilateral 
hearing loss (MBHL), and (3) children with unilateral hearing 
loss (UHL). Both groups of CHL performed the task without 
the use of a hearing aid. Unlike Hicks and Tharpe (2002), analy- 
ses showed a main effect of SNR, but not group (i.e., hearing 
status). Verbal RTs were generally slower in more challenging 


SNRs across all groups, but there was no overall difference 
between CNH, UHL, or MBHL. The lack of group difference 
is in line with a dual-task study investigating top-down control 
of attention in a comparable sample of children with UHL and 
MBHL, which also showed no difference in performance accu- 
racy between groups when using a dot-to-dot game as the sec- 
ondary task (McFadden & Pittman, 2008). Noting that CHL in 
Hicks and Tharpe (2002) had poorer hearing sensitivity (mild- 
to-moderate high-frequency hearing loss), Lewis et al. (2016) 
suggested that the effects of listening effort in children may be 
related to hearing loss severity. It remains to be seen whether 
verbal RTs or dual-task measures are sensitive to differences 
in listening effort between CNH and school-age children with 
greater degrees of hearing loss. 

With regard to ameliorating the increased listening effort 
experienced by CHL, previous studies have investigated the 
effects of digital noise reduction technology (Gustafson et al., 
2014) and auditory stimulus bandwidth (Stelmachowicz et al., 
2007). However, the more general effect of personal amplifica- 
tion (unaided versus aided) on listening effort has not yet been 
examined in school-age CHL. In Gustafson et al. (2014), CNH 
listened to speech processed through a hearing aid with and 
without digital noise reduction and were presented with con- 
sonant-vowel-consonant nonwords in broadband background 
noise. Verbal RTs were slower when digital noise reduction 
was switched off versus when it was switched on, suggesting 
a reduction in listening effort associated with the use of digital 
noise reduction technology. Stelmachowicz et al. (2007) inves- 
tigated the effect of stimulus bandwidth (5 versus 10kHz) on 
dual-task performance in a group of CNH and CHL (aged 7-14 
years). Word recognition and digit recall were used as primary 
and secondary tasks, respectively. No difference in listening 
effort was found between CNH and CHL or between stimulus 
bandwidth conditions. Clearly, further research is needed to bet- 
ter understand the effects of personal amplification on dual-task 
and verbal RT measures of listening effort in CHL. 

The current study examined the effects of hearing status, 
SNR, and amplification on listening effort in a group of school- 
age children. Specifically, we were interested in comparing the 
sensitivity of two commonly used behavioral measures of lis- 
tening effort: (1) dual-task visual RTs, and (2) verbal RTs. We 
hypothesized: 


1. slower dual-task visual RTs and verbal RTs (i.e., increased 
listening effort) in more challenging SNRs across both 
CNH and CHL, consistent with Howard et al. (2010) and 
Lewis et al. (2016); 

2. slower dual-task visual RTs and verbal RTs (i.e., increased 
listening effort) in CHL versus CNH, based on the find- 
ings from Hicks and Tharpe (2002) and the prediction of 
Lewis et al. (2016); 

3. slower dual-task visual RTs and verbal RTs (i.e., increased 
listening effort) in unaided versus aided conditions, sup- 
porting previous research showing reduced listening 
effort in school-age CNH using digital noise reduction 
technology (Gustafson et al., 2014). 


MATERIALS AND METHODS 


This study was a part of a broader research program designed 
to examine the effects of listening effort and fatigue on school- 
age CHL—-see Bess et al. (2014) for an overview of that program. 
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Participants 

A total of 82 children between the ages of 6.0 and 12.9 years 
were included in this study. Within this sample, 37 children had 
normal hearing sensitivity, and 45 children had hearing loss. 
Data for 11 additional CHL and two additional CNH were not 
included in the analyses for the following reasons: (1) word rec- 
ognition performance was less than 20% in all test conditions 
(n= 7), (2) they could not master the dual-task paradigm (n = 2), 
(3) they elected to stop participation prior to completing the task 
(n = 3), or (4) a computer error resulted in a completely missing 
data set (n = 1). Children had no diagnosis of learning disabil- 
ity or cognitive impairment as reported by parents. The parent 
of one child only (in the CHL-aided group) reported that their 
child had vision problems not fully corrected by glasses. For the 
purposes of the larger study, children were also excluded based 
on factors known to affect fatigue. This criterion resulted in the 
exclusion of (a) children who were bilingual or whose primary 
language in the home was not listening and spoken language, 
(b) children with Autism Spectrum Disorder, (c) children with 
linear metabolic or endocrine disorders (e.g., diabetes or hypo- 
thyroidism), (d) children with a chronic medical condition, and 
(e) children who utilized stimulant medications. Children with 
cochlear implants and children with UHL were not included in 
the study. 

Participants were recruited from Vanderbilt’s pediatric audi- 
ology clinics, school systems throughout the middle Tennessee 
area, advertisements in a local parenting magazine, and through 
the Vanderbilt Kennedy Center’s Study Finder website. This 
study was reviewed and approved by the Institutional Review 
Board of Vanderbilt University. All children provided their 
assent, and parents/caregivers provided written informed con- 
sent prior to the initiation of any research procedures. Children 
were compensated for their participation. 

Upon entry into the larger study, each child received an 
audiological assessment and a series of standardized tests to 
assess language and nonverbal intelligence. Language ability 
was measured using the core language index of the Clinical 
Evaluation of Language Fundamentals — Fourth Edition (Wiig 
et al., 2004), providing a reliable, norm-referenced measure of 
language performance by age. Children also received the Test 
of Nonverbal Intelligence - Fourth Edition (Brown et al., 2010). 
Demographic, nonverbal intelligence, and language informa- 
tion obtained at study entry is shown in Table 1 for each group. 

All participants had normal middle ear function verified by 
tympanometry as well as unremarkable otoscopic examinations. 


TABLE 1. Participant Characteristics 


Significance 
CNH CHL (p) 
Participants; males/ 37; 24/13 45; 24/21 
females 
Age (y) 8.92 (2.22) 10.09 (1.87) 0.011 
Language* 110.19 (10.15) 97.02 (20.97) 0.001 


Nonverbal intelligence 110.11 (9.15) 104.44 (12.58) 0.025 
quotientt 


Mean (and SD) age, language, nonverbal intelligence quotient, and number of children 
with mild versus moderate hearing losses for both groups of children enrolled in the study. 
Mild/Moderate HL 0/0 29/16. 

*Standard score on the core language index of the Comprehensive Evaluation of Language 
Fundamentals-Fourth Edition. 

tStandard score on Test of Nonverbal Intelligence-Fourth Edition. 


CNH received a standard hearing screening at 15 dB HL for 
octave frequencies ranging from 0.25 to 8.0kHz, bilaterally. 
CHL received an audiological examination including bilateral 
air and bone conduction threshold testing. CHL had permanent, 
bilateral, sensorineural hearing loss. Losses were in the mild- 
to-moderate range in at least the better-hearing ear. We defined 
mild hearing loss using the following criteria as measured in the 
better hearing ear: a pure tone average (PTA; thresholds at 0.5, 
1.0, and 2.0kHz) between 20 and 40 dB or thresholds greater 
than 25 dB HL at two or more frequencies above 2.0 kHz. Mod- 
erate hearing loss was defined as a PTA of > 40—70 dB HL in the 
better ear. During aided testing, all CHL wore two hearing aids. 
Figure 1 shows a composite audiogram for the CHL included 
in this data set. 


Materials 

Twenty isophonemic lists, each containing 10 consonant- 
vowel-consonant words, were used as test stimuli (Mackersie 
et al., 2001). Of the 20 word lists, the same two lists (lists 13 
and 20) were used for screening, practice, and for secondary- 
task alone trials. The remaining 18 word lists were split into 
two groups for testing in the primary or dual-task conditions 
(Primary task: lists 1-6, 14-16; Dual-task: lists 7-12, 17-19). 
There were two versions of these groups (Word List A and Word 
List B), in which the words were presented in a different order. 
In general, Word List A was used for unaided testing and Word 
List B for aided testing. Thus, there was no replication of word 
lists during a single unaided or aided visit. For those CHL tested 
in both unaided and aided conditions, all word lists were repli- 
cated on the second visit, although the order of words within 
lists varied between visits. The background noise consisted of 
uncorrelated segments of multi-talker babble sampled from 
the “Connected Speech Test” (Cox et al., 1987) and presented 
from four loudspeakers located around the listener (3.5 meters 
from the listener at 45°, 135°, 225°, and 315° azimuths). The 
level of each background-noise loudspeaker was equated and 
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Fig. 1. Composite audiogram for CHL enrolled in the study. 
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adjusted to produce an overall noise level of 56 dB(A) when all 
four loudspeakers were played simultaneously. The background 
noise was presented continuously throughout testing. We opted 
to present our noise at a fixed level of 56 dB (A), rather than fix- 
ing the speech level, to reduce the likelihood of children becom- 
ing uncomfortable while listening to the continuous noise in a 
reverberant setting. The speech level was adjusted by the exam- 
iner during testing to create three SNRs. These levels were cho- 
sen to systematically vary task difficulty while limiting floor 
and ceiling effects. For the CNH, this goal could be achieved 
using three, fixed, SNRs (-4, 0, +4 dB). However, research sug- 
gests that CHL may require more favorable SNRs than CNH to 
achieve comparable performance (Leibold et al., 2013; Ruscetta 
et al., 2005). Therefore, to limit floor and ceiling effects, we 
used three potential SNR combinations (-4, 0, +4 dB; 0, +4, +8 
dB; and +4, +8, +12 dB) for the CHL. Screening procedures 
used to determine each child’s SNR combination are described 
below. To illustrate the systematic variation in task difficulty in 
each SNR combination, we will refer to SNRs within each com- 
bination as Hard, Moderate, and Easy. 


Procedures 

Hearing Aid Measurement * During aided testing, CHL wore 
personal hearing aids using their “as-worn” settings (i.e., no 
programming adjustments were made by research staff prior to 
testing). Real ear—aided responses were measured by a trained 
research assistant for each hearing aid using probe-microphone 
methods on the Audioscan Verifit Real Ear System (Audioscan, 
Dorchester, Ontario) prior to the start of a child’s aided appoint- 
ment. Hearing aid output in the child’s ear, at octave frequen- 
cies, was compared to Desired Sensation Level (DSL; Scollie 
et al., 2005) v5.0 targets using the Verifit’s “standard speech 
signal” (the carrot passage) presented at 65 dB SPL. Figure 2 
shows DSL v5.0 targets and measured real ear—aided response 
values, at octave frequencies from 250 to 4000 Hz, averaged 
across participants who completed the listening effort task in 
the aided condition (n = 41). To assess whether a poor match 
to DSL targets affected listening effort, we used these data to 
calculate a better-ear average root-mean-square (RMS) error for 
each fitting. We also quantified audibility for each participant 
using the speech intelligibility index (SII; ANSI $3.5). SII’s 
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Fig. 2. DSL v5.0 targets and measured real ear aided response values at 
octave frequencies from 250 to 4000 Hz averaged across participants 
included in the aided testing condition 


were calculated using the Verifit in unaided and aided condi- 
tions for average-level speech in quiet (65 dB SPL). 
Experimental Testing + Listening effort testing was con- 
ducted in a 5.9x5.1 2.5 m reverberation chamber modified 
with acoustic blankets to create a moderately reverberant condi- 
tion (average reverberation time; RT60 ~ 450 ms). Children were 
seated in the center of the chamber at a desk that had colored 
handprints on the surface showing where to place their hands. 
They were instructed to rest their hands on the handprints dur- 
ing all tasks unless they were pressing the button during the sec- 
ondary or dual-task conditions. A trained examiner was seated 
in the test room during testing to provide verbal instruction and 
ensure that children remained on-task. 

Screening Test * The SNR combination used for each child 
was determined using a screening test completed upon entry 
to the larger study. For CHL, this screening was completed 
first without hearing aids. Children were asked to repeat two 
10-word lists (lists 13 and 20) at two of the following three 
SNRs: 0, -4, or +8 dB SNR. The goal of this screening was to 
determine a range of SNRs that would minimize floor and ceil- 
ing effects for CHL. To this end, we chose the lowest (hardest) 
SNR at which each child could score at least 20% correct in the 
“hard” condition. Thus, children were tested first at 0 dB SNR. 
If they scored better than 20% correct at 0 dB SNR, they were 
retested at -4 dB SNR. However, if they scored worse than 20% 
correct at 0 dB SNR, they were retested at +8 dB SNR. Children 
who scored at least 20% correct in the -4 dB SNR condition 
were tested with the -4, 0, +4 dB SNR combination. Children 
who scored poorer than 20% at a -4 dB SNR but scored at least 
20% correct at 0 dB SNR were tested with the 0, +4, +8 dB SNR 
combination. Children who scored poorer than 20% in the 0 dB 
SNR but scored at least 20% correct at +8 dB SNR were tested 
using the +4, +8, +12 dB SNR combination. Table 2 shows the 
number of children tested in each SNR combination. 

For CHL who completed aided and unaided testing, the same 
SNR combination was used in both conditions. Ifa child scored 
less than 20% in the +8 dB SNR condition, he/she did not com- 
plete listening effort testing in the unaided condition. In this 
case, the child wore their hearing aids and repeated the screen- 
ing test to determine the lowest (hardest) SNR (from -4 dB to 
+8 dB) at which they could score at least 20% correct. Dur- 
ing this screening, the same two word lists used in the unaided 
testing were used for screening in the aided condition. A total 
of 18 children were unable to complete the testing unaided. 
Of these children, 12 had a “moderate” hearing loss (PTA 
> 40 dB), while six had a “mild” hearing loss (PTA < 40 dB). 
Dual-Task Paradigm « The dual-task paradigm consisted of 
three conditions: primary task alone, secondary task alone, and 
dual-task. The primary task required children to listen to and 
repeat monosyllabic words presented in noise. Speech stimuli 
were presented using a custom MATLAB program and routed 
to an audiometer (GSI 61) to adjust speech levels. The amplified 
speech was presented from a single loudspeaker at 0° azimuth, 
at a distance of 1.5 meters from the child. 

Primary Task Conditions * Nine word lists (three, 10-word 
lists x 3 SNRs; 90 words total) were administered in the primary 
task conditions. Word-list order was held constant and SNR con- 
dition was counterbalanced across participants to avoid order 
effects. Prior to the presentation of the auditory stimuli, a green 
circle with a cartoon ear was shown on the computer screen to 
prompt the child to listen for the upcoming word. Children were 
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TABLE 2. Total Number of Participants Who Completed Testing in Each of the Three SNR Combinations 


Test SNRs (in dB) CNH CHL Unaided Only CHL Aided Only CHL Unaided and Aided Total 
-4, 0, +4 37 16 7 13 73 
0, +4, +8 0 3 3 3 9 
+4, +8, 412 0 8 8 7 23 


encouraged to guess if they were unsure of the word presented. 
Children’s verbal responses were recorded using a head-worn 
microphone and saved for later analysis. 

Secondary Task Conditions * The secondary task was a 
measure of visual response time. Children were instructed to 
monitor a computer screen located directly below the front 
loudspeaker for the presence of a brief (125ms), randomly 
presented, visual target (a 24x 18cm white rectangle against 
a gray background), and to press a button as quickly as pos- 
sible when it appeared. Prior research has shown that auditory 
background noise can influence response times on visual tasks 
and that this influence can vary depending on the characteristics 
of the background noise (Bendixen et al., 2010; Fischer et al., 
2010; Stoffels & van der Molen, 1988). Therefore, to obtain 
a reliable estimate of the baseline cognitive resources required 
for secondary task performance in our test conditions, primary 
task auditory stimuli were also presented during the secondary 
task assessment. Secondary task testing was conducted at the 
same SNRs used during the primary and dual-tasks, but the 
child was instructed to ignore the words and respond as quickly 
as possible to the visual target. Six, 10-word lists (two lists x 
three SNRs) were used to obtain baseline performance on the 
secondary task. Eight trials in each 10-word list, contained one 
(four trials) or two (four trials) visual target(s). Two trials did 
not contain a visual target resulting in a total of 12 visual targets 
in each 10-word block. When two visual stimuli were presented 
during a single word trial they were separated in time by 1-2 
seconds. The eight trials containing visual flashes, as well as 
the number of flashes (one or two) during a trial, were randomly 
selected. When present, a visual target could occur before, dur- 
ing, or after the presentation of the word—with no more than 
two targets presented within a single trial. Thus, a total of 72 
visual targets (24 in each SNR) were randomly presented dur- 
ing the six, 10-word lists for the secondary task. Responses to 
these stimuli were used to determine baseline secondary task 
RTs (single-task visual RT). RTs to visual stimuli were recorded 
using MATLAB. Due to a programming error, we were unable 
to obtain reliable data regarding response accuracy to visual 
targets. 

Dual-Task Conditions * For the dual-task, children were 
asked to repeat back the words in noise (primary task) while 
remaining vigilant for the visual target (secondary task). Nine 
additional 10-word lists and 108 visual targets (36 in each SNR) 
were presented in the dual-task condition. Children were not 
asked to prioritize one task over the other, given that this strat- 
egy has been shown to be ineffective for this particular age- 
group (Choi et al., 2008). 

Children were given at least one practice session consist- 
ing of a 10-word list presented at the Easy SNR in each of the 
three conditions (primary, secondary, and dual-task). This prac- 
tice list was not repeated during experimental testing. During 
the secondary and dual-task practice conditions, children were 
required to correctly respond to at least 80% of the secondary 


task trials. For the primary and dual-task practice, children were 
required to attempt to repeat at least 8 of the 10 words. 

Word Recognition * Responses from the primary and dual- 
task conditions were recorded using a head-worn microphone 
and were transcribed off-line by trained graduate students. 
Responses were scored as correct or incorrect at the word level. 
Responses were deemed correct if all phonemes were correctly 
recalled, and no additional phonemes uttered (e.g., a response of 
“cats” would be incorrect if the stimulus was “cat”). Two inde- 
pendent reviewers transcribed responses, with discrepant scores 
resolved by a third trained reviewer. 


Measures of Listening Effort 

Dual-Task Visual RTs * The time elapsed from the visual tar- 
get flash to the child’s button press in the secondary task was 
calculated automatically using MATLAB. Based on recommen- 
dations in Gagné et al. (2017), a proportional dual-task visual 
RT was calculated using the following formula: baseline RT— 
dual RT/baseline RT x 100. “Baseline RT” refers to secondary 
task RT when the visual monitoring task was performed in iso- 
lation. “Dual RT” refers to secondary task RT in the dual-task 
condition. Dual-task visual RTs therefore represent the propor- 
tional RT change in secondary task performance. This method 
of quantifying listening effort helps to account for the influence 
of potential baseline differences in secondary task performance 
across participants. For ease of interpretation, scores were sub- 
tracted from zero (1.e., inverted) so that higher scores indicate 
increased listening effort. 

Verbal RTs + Using audio recordings of the children’s 
responses in the primary task condition, we calculated the 
time elapsed from the onset of the stimulus to the onset of 
the response. Trained research assistants used a custom-made 
MATLAB program to manually select the onset of each child’s 
response in each trial via visual examination of the time wave- 
form and auditory confirmation of the recording. Incidental 
sounds (mouth noises, room noise, and so on) unrelated to 
speech production were not included as part of the participant’s 
response when determining the response onset time. In situa- 
tions where the participant’s response was halted or self-cor- 
rected, the response onset time analyzed was the onset of the 
self-corrected, second utterance. Coders had the opportunity to 
identify trials in which they felt further review from a second 
coder was needed. In the event that the second coder’s selected 
time showed a discrepancy of > 25ms from the initial coder’s 
value, the two coders met in-person for consensus coding. Of 
the 247 flagged trials, only 4.86% required consensus coding 
(i.e., a discrepancy of > 25ms was present between coders). 
Periodic reliability checks were conducted to compare differ- 
ent coders’ analyses of a subset of trials. For every condition 
analyzed by one coder, a separate coder randomly selected and 
analyzed 10% of responses from that same condition. Reliabil- 
ity between coders was calculated monthly to monitor for coder 
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drift. Interrater reliability remained high (r > 0.95) for the dura- 
tion of the data collection process. 


Statistical Analyses 

Results of analyses conducted over the entire data set are 
reported. Some previous listening effort studies report listening 
effort measures derived using data from correct word recogni- 
tion responses only, as well as the entire data set (e.g., Lewis 
et al. 2016). Analysis of reaction times based on only correct 
response data revealed the same main effects and/or interaction 
effects as analysis over the entire data set in the current study. 
Thus, for simplicity, we report only data from the full data set 
(i.e., results based on both correct and incorrect responses). Lis- 
tening effort (dual-task visual RTs and verbal RTs) data were 
analyzed using a Linear Mixed-effects Model (LMM). Analyses 
were conducted with SNR (Easy, Moderate, Hard) as a within- 
subjects factor and hearing status (CNH versus CHL Unaided; 
CNH versus CHL Aided) as a between-subjects factor. A sepa- 
rate within-subjects analysis was then conducted to assess the 
effect of amplification on the subset of CHL (n = 23) who com- 
pleted the experiment in both aided and unaided conditions. 
Because our groups differed significantly in age, language, and 
nonverbal intelligence (Table 1), all three were added as covari- 
ates for any between-subjects analyses. Random effects were 
included to account for individual variance in intercepts and 
slopes for any within-subject factors (SNR and amplification). 
All analyses were conducted in R (R Development Core Team, 
2011). The “afex” package was used for all mixed-effects mod- 
eling analyses (Singmann et al., 2015). 

It is well documented that raw RT and binary response 
data are often skewed and therefore not normally distributed, 
rendering parametric statistical analyses inappropriate (Lo & 
Andrews, 2015; Ratcliff, 1979; Whelan, 2008). Generalized 
Linear Mixed-effects Models (GLMMs) were therefore used 
for the statistical analysis of verbal RTs and primary task word 
recognition data. A GLMM is a form of LMM that allows the 
researcher to specify the response distribution of the dependent 
variable. For verbal RTs analysis, a “gamma” distribution was 
specified in the model, as this distribution more closely approxi- 
mates the surface characteristics of raw RT data; a unimodal 
skew with all responses greater than 0 (Lo & Andrews, 2015). 
For primary task performance data, a “binomial” distribution 
was specified to capture the binary nature of the response data 
(i.e., “0” for incorrect, and “1” for correct verbal responses). 
This approach to analyzing non-normal data is advocated in 
Baayen et al. (2008) and was also used in the analysis of ver- 
bal RTs and speech recognition performance data in Lewis et 
al. (2016). p Values for both LMM and GLMM analyses were 
obtained using likelihood ratio tests, as recommended in Barr 
et al. (2013) for data with a large number of observations and 
subjects. Post hoc pairwise comparisons were conducted using 
least-squares means testing from the “lsmeans” package in 
R (Lenth & Hervé, 2014). The “Tukey HSD” method for p value 
adjustment of multiple-comparison testing was applied. 


RESULTS 


CNH Versus CHL Unaided 

Word Recognition * Figure 3 displays word recognition per- 
formance as a function of SNR and hearing status. Analysis 
revealed a significant main effect of hearing status (7 [1] = 36.56, 
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Fig. 3. Across-group mean performance accuracy (%) scores (+ 95% Cls) as 
a function of hearing status (CNH, filled black circles; CHL Unaided, open 
triangles) and SNR (Easy, Moderate, Hard). 


p< 0.001), with word recognition scores significantly higher for 
the CNH (M = 62%, SD = 7%) compared with CHL Unaided 
(M = 37%, SD = 9%). The analysis also revealed a main effect 
of SNR (x? [2] = 110.87, p < 0.001) but no interaction (¥? [2] 
= 2.73, p = 0.26). Post hoc tests comparing SNR conditions 
collapsed across hearing status revealed a systematic increase 
in word recognition as the SNR improved (Easy > Moderate, 
6B = 0.51, z = 6.87, p < 0.001; Moderate > Hard, B = 0.74, 
z = 9.94, p < 0.001). Mean word recognition performance 
improved in Easy versus Moderate by 11%, and an additional 
15% in Moderate versus Hard. Overall, word recognition was 
significantly better in the single (M = 52%, SD = 9%) versus 
dual-task (M=47%, SD = 9%) condition (y? [1] = 6.33, p=0.01). 
However, there was no interaction between task (single versus 
dual) and hearing status (v7 [1] = 1.54, p = 0.22) or between task 
and SNR (72 [2] = 2.10, p = 0.35). There was also no significant 
three-way interaction between task, hearing status, and SNR (v7 
[2] = 1.27, p = 0.53; in situations where there is a significant 
change in primary task performance between single- and dual- 
task conditions, Gagné et al. (2017) suggest analyzing the pro- 
portional change in primary task performance from single- to 
dual-conditions also as a potential marker of listening effort. 
Analysis on proportional change data yielded similar findings 
to the dual-task visual RT data (all ps > 0.05). 

Dual-Task Visual RTs * Figure 4 (left panel) displays dual- 
task visual RTs (i.e., the percentage change in dual RT versus 
baseline RT performance) as a function of SNR and hearing 
status (CNH versus CHL Unaided). Analysis of dual-task visual 
RTs revealed no main effect of hearing status (xy? [1] = 0.67, 
p = 0.41) or SNR (x2 [2] = 2.35, p = 0.31) and no interaction 
(x? [2] = 1.27, p = 0.53). Analyses on baseline RTs revealed no 
significant main effects of hearing status or SNR, and no inter- 
action (all ps > 0.05). 

Verbal RTs * Figure 4 (right panel) displays verbal RTs 
as a function of SNR and hearing status (CNH versus CHL 
Unaided). Analysis revealed a significant main effect of hearing 
status (‘7 [1] = 16.58, p < 0.001), with verbal RTs significantly 
slower in CHL Unaided compared with CNH. The analysis also 
revealed a main effect of SNR (y? [2] = 26.22, p < 0.001) but no 
interaction (y? [2] = 0.10, p = 0.95). Post hoc tests comparing 
SNR conditions collapsed across hearing status revealed that 
verbal RTs became faster as the SNR improved. However, while 
the difference between Hard and Moderate was significant 
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Fig. 4. Across-group means (+ 95% Cls) for dual-task visual RTs (left panel) 
and verbal RTs (right panel; in seconds) as a function of hearing status 
(CNH, filled black circles; CHL Unaided, open triangles) and SNR (Easy, 
Moderate, Hard). 


(B = 0.03, z = 4.25, p < 0.001), the difference between Mod- 
erate and Easy did not reach significance (6 = 0.01, z = 1.88, 
p=0.15). 


CNH Versus CHL Aided 

Word Recognition * Figure 5 displays word recognition per- 
formance accuracy scores as a function of SNR and hearing sta- 
tus. Analysis revealed a significant main effect of hearing status 
(7 [1] = 60.31, p < 0.001), with word recognition scores sig- 
nificantly higher in CNH (M = 62%, SD = 7%) compared with 
CHL Aided (M = 33%, SD = 8%). The analysis also revealed a 
main effect of SNR (2 [2] = 126.33, p < 0.001) but no interac- 
tion (7 [2] = 4.30, p = 0.12). Post hoc tests comparing SNR 
conditions collapsed across hearing status revealed a systematic 
increase in word recognition as the SNR improved (Easy > Mod- 
erate, § = 0.48, z= 7.23, p < 0.001; Moderate > Hard, 8B = 0.82, 
z= 11.17, p < 0.001). Mean word recognition improved in Easy 
versus Moderate by 11 percentage points, and an additional 
16 percentage points in Moderate versus Hard. Overall, word 
recognition was significantly better in the single- (= 47%) 
versus dual-task (M = 44%) condition (vy? [1] = 6.71, p = 0.01). 
However, there was no interaction between task (single versus 
dual) and hearing status (v7 [1] = 1.31, p = 0.25) or between task 
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Fig. 5. Across-group mean performance accuracy (%) scores (+ 95% Cls) 
as a function of hearing status (CNH, filled black circles; CHL Aided, filled 
triangles) and SNR (Easy, Moderate, Hard). 
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Fig. 6. Across-group means (+ 95% Cls) for dual-task visual RTs (left panel) 
and verbal RTs (right panel; in seconds) as a function of hearing status 
(CNH, filled black circles; CHL Aided, filled triangles) and SNR (Easy, 
Moderate, Hard). 


and SNR (72 [2] = 3.33, p = 0.19). There was also no significant 
three-way interaction between task, hearing status, and SNR 
(x? [2] = 1.35, p = 0.51). 

Dual-Task Visual RTs * Figure 6 (left panel) displays dual- 
task visual RTs as a function of SNR and hearing status (CNH 
versus CHL Aided). Analysis of dual-task visual RTs revealed 
no main effect of hearing status (y? [1] = 2.01, p = 0.16) or 
SNR (x2 [2] = 0.46, p = 0.79) and no interaction (7? [2] = 4.93, 
p = 0.09). Analyses on baseline RTs revealed no significant 
main effects of hearing status or SNR, and no interaction (all 
ps > 0.05). 

Verbal RTs ¢ Figure 6 (right panel) displays verbal RTs as a 
function of SNR and hearing status (CNH versus CHL Aided). 
Analysis revealed a significant main effect of hearing status 
(x7 [1] = 18.33, p < 0.001), with verbal RTs significantly slower 
in CHL Aided compared with CNH. The analysis also revealed 
a main effect of SNR (y? [2] = 29.84, p < 0.001) but no interac- 
tion (x? [2] = 2.28, p = 0.32). Post hoc tests comparing SNR 
conditions collapsed across hearing status revealed that verbal 
RTs became significantly faster as the SNR improved (Easy 
> Moderate, B = 0.02, z = 3.16, p = 0.004; Moderate > Hard, 
6 = 0.03, z = 4.06, p < 0.001). 


CHL Unaided Versus CHL Aided 

Word Recognition * Figure 7 displays unaided and aided word 
recognition scores as a function of SNR for the CHL. Analysis 
revealed no significant main effect of amplification (7 [1] = 
0.47, p = 0.49). A significant main effect of SNR was found 
(x? [2] = 50.56, p < 0.001), but no interaction (y? [2] = 1.78, 
p = 0.41). Post hoc tests comparing SNR conditions collapsed 
across amplification revealed a systematic increase in word 
recognition as the SNR improved (Easy > Moderate, 6 = 0.60, 
z = 6.36, p < 0.001; Moderate > Hard, B = 0.78, z = 8.19, p < 
0.001). Mean word recognition performance improved in Easy 
versus Moderate by 14 percentage points, and an additional 
14 percentage points in Moderate versus Hard. Overall, word 
recognition was significantly better in the single- (Z = 36%) 
versus dual-task (M = 32%) condition (y? [1] = 4.18, p = 0.04). 
However, there was no interaction between task (single versus 
dual) and amplification (x? [1] = 0.29, p = 0.59) or between task 
and SNR (x? [2] = 1.16, p = 0.56). There was also no significant 
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Fig. 7. Across-group mean performance accuracy (%) scores (+ 95% Cls) as 
a function of amplification (CHL Unaided, open triangles; CHL Aided, filled 
triangles) and SNR (Easy, Moderate, Hard). 


three-way interaction between task, amplification, and SNR (x? 
[2] = 1.18, p =0.55). 

Dual-Task Visual RTs * Figure 8 (left panel) displays dual- 
task visual RTs as a function of SNR and amplification (CHL 
Unaided versus CHL Aided). Analysis of dual-task visual RTs 
revealed a larger increase in listening effort when unaided; how- 
ever, the main effect of amplification was not significant (7 [1] 
= 3.04, p = 0.08). Likewise, the main effect of SNR (x? [2] = 
2.51, p = 0.28) and the interaction effect (v7 [2] = 5.33, p = 0.07) 
were not significant. Analyses of unaided and aided baseline 
RTs as a function of SNR revealed no significant main effects 
or interactions (all ps > 0.05). 

Verbal RTs * Figure 8 (right panel) displays verbal RTs as a 
function of SNR and amplification (CHL Unaided versus CHL 
Aided). Analysis revealed a significant main effect of SNR (x? 
[1] = 11.86, p = 0.003), but no main effect of amplification (y? 
[2] = 0.96, p = 0.33), and no interaction (¥? [2] = 0.72, p = 0.70). 
Post hoc tests comparing SNR conditions collapsed across 
amplification revealed that verbal RTs became faster as the 
SNR improved. However, while the difference between Hard 
and Moderate was significant (8 = 0.02, z = 3.39, p = 0.002), 
the difference between Moderate and Easy did not reach signifi- 
cance (6 = 0.01, z = 2.04, p = 0.10). 
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Fig. 8. Across-group means (+ 95% Cls) for dual-task visual RTs (left panel) 
and verbal RTs (right panel; in seconds) as a function of amplification 
(CHL Unaided, open triangles; CHL Aided, filled triangles) and SNR (Easy, 
Moderate, Hard). 


DISCUSSION 


The goal of this study was to examine the effects of SNR, 
hearing loss, and amplification on listening effort in school- 
age CNH and CHL. We quantified listening effort using two 
behavioral measures: verbal RTs and dual-task visual RTs. We 
predicted slower verbal RTs and visual RTs in more challenging 
SNRs across both CNH and CHL (hypothesis 1). Verbal RTs 
were found to be slower in more challenging SNRs for both 
CNH and CHL, but there was no effect of SNR on dual-task 
visual RTs for CNH or CHL (Figs. 4, 6, 8). We also predicted 
slower dual-task visual RTs (i.e., greater dual-task cost) and 
verbal RTs in CHL versus CNH (hypothesis 2). Overall, verbal 
RTs were significantly slower in CHL versus CNH. However, 
no effect of hearing status (CNH versus CHL) was found on 
dual-task visual RTs. Finally, we predicted slower dual-task 
visual RTs and verbal RTs in unaided versus aided conditions 
(hypothesis 3); however, we found no effect of amplification 
(CHL Aided versus CHL Unaided) on either dual-task visual 
RTs or verbal RTs. This is the first study to compare verbal RTs 
and dual-task measures of listening effort in the child popula- 
tion. The current findings extend the literature by demonstrating 
an effect of hearing loss on verbal RTs in school-age children. 


Effect of SNR on Listening Effort 

Previous research demonstrates that verbal RTs are sensitive 
to the effects of SNR (Gustafson et al., 2014; Lewis et al., 2016) 
in school-age children. Consistent with this previous work, we 
found that verbal RTs were generally slower in more challeng- 
ing SNRs for both CNH and CHL. Previous studies using the 
dual-task paradigm, however, have shown mixed results when 
determining the effects of SNR on listening effort in children 
(Howard et al., 2010; Hicks and Tharpe, 2002). Findings from 
the current study corroborate Hicks and Tharpe (2002) by 
showing no significant main effect of SNR on dual-task visual 
RTs across both CNH and CHL. 

Discrepant results using the dual-task paradigm could reflect 
the substantial differences in task methodologies across stud- 
ies. For instance, a variety of different secondary tasks have 
been used in previous studies using the dual-task paradigm to 
investigate listening effort (Gagne, et al., 2017). Digit recall was 
used as the secondary task by Howard et al. (2010), who found 
increased listening effort in more negative SNRs. Conversely, 
the secondary task used in the current study and by Hicks and 
Tharpe (2002) was a simple button press in response to a visual 
probe. Two recent studies have examined the effect of secondary 
task complexity (deep versus surface-level processing) on sensi- 
tivity to listening effort in children using the dual-task paradigm 
(Picou et al., 2017; Hsu et al., 2017). Neither study investigated 
digit recall as a secondary task, as in Howard et al. (2010). How- 
ever, their findings suggest that secondary tasks requiring deeper 
levels of semantic processing (e.g., extracting word meaning) 
are no more sensitive to the effects of noise than simple (e.g., 
response to visual probe) secondary tasks. In contrast, relatively 
few studies have opted to use verbal RTs as a measure of listen- 
ing effort in children (Lewis et al., 2016; Gustafson et al., 2014). 
Our finding of increased listening effort with worsening SNR is 
consistent with these previous studies. 

Another potential source of discrepancy among studies 
examining the effect of SNR on listening effort using dual-task 
paradigms is the performance level in the primary task. It has 
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been proposed that an effort “threshold” exists whereby effort 
generally increases until a task becomes too difficult, at which 
point effort will likely decrease (Pichora-Fuller et al., 2016). 
Consistent with this notion, research investigating listening 
effort using pupillometry in adults with hearing loss shows that 
listening effort plateaus, and even decreases, when a task starts 
to exceed an individual’s cognitive capacity due to increasing 
acoustic demands (Ohlenforst et al., 2017b; Zekveld et al., 
2011). A recent study by Wu et al. (2016) investigating the psy- 
chometric functions of dual-task paradigms in adult listeners 
suggests that listening effort is likely to be maximal at SNRs 
corresponding to a word recognition score of 30-50% correct. 
That is, secondary task performance decreased (indicating 
more listening effort) until speech recognition scores reached 
30-50% accuracy. When primary task performance was better, 
or poorer, than 30-50%, secondary task performance increased 
(indicating a reduction in listening effort). The results of our 
study are consistent with this pattern. Specifically, the favor- 
able SNRs used by Hicks and Tharpe (2002), who found no 
effect of SNR on listening effort, yielded average word recogni- 
tion performance > 85%. Conversely, speech recognition in the 
study by Howard et al. (2010), where significant effects of SNR 
on listening effort were found, averaged between 50% and 80% 
correct. The poor word recognition scores in our study suggest 
that the SNRs and reverberant conditions were so difficult that 
some participants might have experienced cognitive overload 
and/or disengaged from the primary task—resulting in no effect 
of SNR on listening effort. This is especially apparent in our 
finding that dual-task visual RTs did not differ significantly (and 
in some cases even appeared to improve numerically) between 
Moderate and Hard SNR conditions. 


Effect of Hearing Loss on Listening Effort 

Previous studies that have examined listening effort in CHL 
versus CNH show discrepant results (Hicks & Tharpe, 2002; 
Lewis et al., 2016; McFadden & Pittman, 2008; Steel et al., 
2015). Some studies report overall increased listening effort 
in CHL versus CNH as revealed using the dual-task paradigm 
(Hicks & Tharpe, 2002) as well as behavioral and physiological 
measures (Steel et al., 2015). On the other hand, both verbal 
RTs (Lewis et al., 2016) and dual-task paradigms (McFadden & 
Pittman, 2008) have also shown no overall effect of hearing loss 
on listening effort. Findings from the current study broadly sup- 
port Hicks and Tharpe (2002) and Steel et al. (2015) by showing 
an effect of hearing loss on listening effort. However, verbal 
RTs (and not dual-task visual RTs) appear to be more sensitive 
to the detrimental effect of hearing loss. 

The lack of an effect of hearing loss on dual-task visual RTs 
is consistent with McFadden and Pittman (2008) but not Hicks 
and Tharpe (2002). Potential reasons for these discrepant results 
are discussed in the previous subsection (e.g., the possibility 
of an effort “threshold” and/or differences in task methodol- 
ogy). Verbal RT findings from the current study are not con- 
sistent with Lewis et al. (2016) who used a similar verbal RT 
paradigm to assess the effect of hearing loss on listening effort 
in school-age children. This could relate to differences in the 
range of hearing loss severity included across studies. That is, 
CHL in Lewis et al. (2016) had relatively less severe (unilat- 
eral or mild bilateral) hearing loss than the CHL included in 
the current study, who had mild-to-moderate bilateral hearing 


impairments, as well as those studied by Steel et al. (2015), who 
were cochlear implant users. It has been suggested that listen- 
ing effort could be increased in children with greater degrees of 
hearing loss but not in those with minimal or mild hearing loss 
(Lewis et al., 2016). To determine whether degree of hearing 
loss was related to listening effort in our sample of CHL rang- 
ing from mild to moderate, we conducted further correlation 
analyses. Specifically, we investigated the relationship between 
degree of hearing loss (PTA) and both measures of listening 
effort (dual-task visual RTs and verbal RTs). No significant cor- 
relations were found between PTA and measures of listening 
effort in CHL Unaided or CHL Aided (all ps > 0.05). These 
findings suggest that degree of hearing loss (PTA) does not have 
a strong effect on listening effort as measured using either ver- 
bal RTs or dual-task visual RTs. It is possible, however, that the 
current study sample (children with mild-to-moderate hearing 
loss) was not sufficiently heterogeneous to uncover systematic 
variance as a function of PTA. Furthermore, it is also possible 
that our decision to use different SNR combinations across chil- 
dren (to reduce floor/ceiling effects) may have reduced our abil- 
ity to detect differences associated with degree of hearing loss. 

Another potential reason for the discrepant verbal RT find- 
ings between this study and Lewis et al. (2016) relates to the 
choice of background noise and/or listening conditions. CHL 
are known to be more adversely affected by reverberation than 
CNH (Finitzo-Hieber & Tillman, 1978). It is possible that the 
combination of multi-talker babble and a reverberant test envi- 
ronment (RT60 ~ 450 ms) in the current study resulted in listen- 
ing conditions that were more adverse, and thus required more 
effort, than those used in Lewis et al. (2016), which included 
testing in double-walled and sound-treated test booths. As 
such, mean word recognition was ~80% for CHL in Lewis et 
al. (2016) and ~50% in the current study for the CHL Unaided 
group in the Easy SNR condition. While adult studies have 
shown that the addition of reverberation to background noise 
causes increases in listening effort that are minimal (Rennies et 
al., 2014; Picou et al., 2016), further research is needed to deter- 
mine if the combination of background noise and reverberation 
has a greater impact on listening effort in children than adults, 
particularly those with hearing loss. 


Effect of Amplification on Listening Effort 

Although research investigating the impact of amplification 
on listening effort in the adult population has increased rapidly 
in recent years (see Ohlenforst et al. 2017a, for a review), studies 
investigating the effect of assistive hearing technology on lis- 
tening effort in children are relatively sparse (Gustafson et al., 
2014; Stelmachowicz et al., 2007). Gustafson et al. (2014) found 
that verbal RTs were slower when digital noise reduction was 
switched off versus when it was switched on, suggesting reduced 
listening effort associated with the use of digital noise reduc- 
tion technology. In the current study, no difference in dual-task 
visual RTs or verbal RTs were found when CHL were aided ver- 
sus unaided. The current findings show a trend toward a larger 
dual-task visual RTs (i.e., increased listening effort) in unaided 
versus aided conditions (Fig. 8); however, the effect of amplifi- 
cation failed to reach statistical significance (p = 0.08). Although 
dual-task visual RTs were relatively more sensitive than verbal 
RTs in demonstrating some aided benefit in CHL, overall the use 
of hearing aids did not reduce listening effort as hypothesized. 
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There are several possible reasons for the lack of any statisti- 
cal differences between aided and unaided listening in terms 
of word recognition and/or listening effort. First, any poten- 
tial benefit from amplification in terms of increased audibility 
(A paired t-test was conducted based on data from CHL for 
whom we had both aided and unaided SII estimates of audi- 
bility (n = 20). As expected, SII estimates of audibility were 
significantly higher (i.e., better) in the aided versus the unaided 
condition, 7(19) = 5.38, p < 0.001) was minimized in the noisy 
and reverberant test conditions, particularly in the more chal- 
lenging SNR conditions. Because children’s hearing aid fittings 
were “as worn” and not set to match prescriptive targets, it is 
feasible that aided benefit for some children was not optimal. 
That is, the quality of each child’s hearing aid fitting may have 
influenced listening effort findings. To examine the relationship 
between adequacy of the hearing aid fitting and listening effort, 
we conducted further correlation analyses between better-ear 
average RMS error (i.e., match to DSL targets) and each mea- 
sure of listening effort. Overall, we found no significant correla- 
tions between fit-to-target RMS error and dual-task visual RTs 
(r = -0.11, p = 0.50) or verbal RTs (7 = -0.01, p = 0.97). This 
suggests that any variations in match to DSL targets in our par- 
ticipants’ “as worn” hearing aid fittings had a minimal effect on 
listening effort in the aided condition. 

We also explored the impact of unaided/aided audibility on 
listening effort using SII values obtained from the Verifit. Cor- 
relation analyses revealed no significant association between 
unaided or aided SIIs and any measure of listening effort (all 
ps > 0.05). Likewise, unaided/aided changes in SII were not 
significantly correlated with changes in listening effort across 
both measures (all ps > 0.05). While we were able to investi- 
gate the relationship between audibility in quiet conditions (at 
65 dB SPL) and listening effort, we were unable to examine the 
extent to which audibility in noise (i.e., the test conditions used 
in the study) impacted listening effort when CHL were aided 
versus unaided. It is plausible that the noisy and reverberant 
test conditions served to reduce aided/unaided differences in 
audibility in some CHL (i.e., the background noise elevated 
hearing thresholds to a similar level in aided and unaided 
conditions). 


Dual-Task Visual RTs Versus Verbal RTs 

Results from the current study suggest that verbal RTs are 
more sensitive to the effects of SNR and hearing loss than dual- 
task visual RTs in school-age children. This finding is consistent 
with a study investigating the sensitivity of dual-task visual RTs 
versus verbal RTs in the adult population, which showed that 
verbal RTs were more sensitive to the effect of speech intelligi- 
bility than dual-task visual RTs (Pals et al., 2015). In the current 
study, dual-task visual RTs showed relatively greater sensitiv- 
ity to the effect of amplification than verbal RTs. However, the 
effect did not reach statistical significance and should therefore 
be interpreted with caution. Dual-task visual RTs also showed 
more variability around the mean than verbal RTs (see CIs in 
Figs. 4, 6, 8). This increased variability may be at least partly 
attributed to the use of a relative change value that includes 
pooled variance from both baseline and dual-task conditions. 
It may also be the case that extraneous factors (e.g., cognitive 
ability) contribute to overall performance variability during the 
dual-task experiment, which requires higher-level attentional 


and cognitive processing compared with speech recognition 
alone. 

Verbal RT measures have shown promise in both the adult 
(Gatehouse & Gordon, 1990; Pals et al. 2015) and pediatric 
(Gustafson et al., 2014; Lewis et al., 2016, Steel et al., 2015) 
populations as a potential marker of listening effort. The dual- 
task paradigm has been used to demonstrate effects of SNR, 
hearing loss, and amplification in the adult population; see 
Gagné et al. (2017) for an extensive review. However, the inter- 
pretation of dual-task data is considered more problematic in 
pediatric populations (Choi et al., 2008; McFadden & Pittman, 
2008). The ability to multi-task is clearly an important skill to 
master in classroom learning environments (e.g., listening to the 
teacher’s instructions while taking notes; Howard et al. 2010). 
However, given the unpredictable nature of attention allocation 
in children and the dual-task method’s reliance on assumptions 
regarding cognitive resource allocation, this approach may not 
be an ideal technique for objectively measuring listening effort 
in children. On the other hand, interpretation of verbal RT data 
is relatively straight-forward as it reflects a behavioral response 
to a single task without additional sources of distraction and 
reflects mental processing limited to the auditory modality. Ver- 
bal RTs may also represent a more viable alternative to dual- 
task and/or physiological measures of listening effort that can 
be more readily used as part of a test battery in the audiology 
clinic. For example, verbal RT information can be obtained 
based on simple speech recognition tests already routinely per- 
formed in the clinic, thus removing the need for additional test- 
ing (e.g., incorporating multiple tasks) and/or costly equipment 
(e.g., for physiological recordings). A reliable and sensitive 
measure of listening effort could help to identify CHL who are 
candidates for different types of rehabilitation (e.g., assistive 
devices or cognitive training) and could also be used to help 
optimize hearing aid settings. 


Study Limitations and Future Directions 

Several aspects of this study may limit the generalizability 
of results. Due to a programming error, we were unable to col- 
lect reliable accuracy data for responses to visual targets. In a 
recent study, Grieco-Calub et al. (2017) used the dual-task para- 
digm to assess multi-tasking abilities in a group of school-age 
CNH. The primary task was a speech recognition task. Speech 
was noise-band vocoded with 4, 6, or 8 spectral channels. The 
secondary task was a visual monitoring task. A decrement in 
secondary task (visual monitoring) accuracy, but not RTs, was 
found in the more challenging (4 and 6 spectral channel) listen- 
ing conditions. It is therefore possible that a dual-task decre- 
ment in secondary task performance accuracy may have been 
present in the current study. While this may be the case, other 
dual-task studies in the literature show that secondary task 
accuracy and secondary task RTs often show a similar pattern of 
results (Anderson Gosselin & Gagne, 2011; Fraser et al., 2010). 
Because dual-task visual RTs (and not accuracy) are more com- 
monly used in the literature to assess listening effort, an exami- 
nation of their sensitivity was warranted. 

Given the limited experimental control over hearing aid set- 
tings in the current study, we are unable to draw firm conclusions 
regarding the effect of well-fitted amplification on listening 
effort in children. Although the main effect of SNR on listen- 
ing effort shown here suggests that better audibility yields less 
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listening effort, we found limited evidence that SII estimates of 
audibility (in quiet) or hearing aid fitting accuracy (fit-to-target 
RMS error) influence listening effort in CHL. This suggests that 
there are likely additional factors (independent of audibility and 
hearing aid fitting) that contribute to increased listening effort 
in CHL versus CNH. Future research should examine if cur- 
rently available methods of SNR improvement (e.g., directional 
microphones, remote microphone systems) reduce listening 
effort in CHL. The effect of different types of background noise 
(e.g., single- versus multi-talker masker) on verbal RTs should 
also be explored in school-age children. Previous research sug- 
gests that CHL may be especially susceptible to the negative 
effects of speech maskers (Leibold et al., 2013). In recent years, 
listening-related effort and fatigue have also been measured in 
pediatric populations using physiological techniques, such as 
pupillometry (McGarrigle et al., 2017) and event-related poten- 
tials (Key et al., 2017; Gustafson et al., 2018). Inclusion of 
physiological markers of listening effort may help to elucidate 
factors independent of audibility that influence listening effort. 
Future research should also consider the impact of the duration 
of hearing loss and/or the age at which a child is fitted with a 
hearing device on subsequent listening effort. 


CONCLUSIONS 


This is the first study to compare two behavioral measures 
of listening effort in children. Verbal RTs appear more sensitive 
than dual-task visual RTs to the effects of SNR and hearing loss 
in school-age children. These findings suggest that inhibiting 
distracting noise requires more cognitive resources when the 
background noise level is increased, and this processing speed 
decrement is generally more pronounced in CHL versus CNH. 
Given the fast-paced nature of typical classroom exchanges, 
any slowing in mental processing will likely have a detrimental 
impact on learning and language development; both of which 
rely heavily on accurate speech comprehension. 
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